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(57) ABSTRACT 

A method for accessing a digital image capture unit via a 
communication network comprising a server computer sys- 
te m and a client computer system communicativelv courrted 
with commupication equipment. In on e embodiment, the 
address of the'digital image capture uniFis registered' in an 
executable program on the server computer system. The 
executable program is accessed by the client computer 
system. The executable program connects the digital image 
capture unit and the server computer system. The executable 
program communicates commands between the client com- 
puter system and the digital . image capture unit, such that 
data captured by the digital image capture unit is transferred 
to the client computer system via the server computer 
system. 

27 Claims, 11 Drawing Sheets 
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METHOD AND SYSTEM ALLOWING A 

CLIENT COMPUTER TO ACCESS A 
PORTABLE DIGITAL IMAGE CAPTURE 
UNIT OVER A NETWORK 

HELD OF THE INVENTION 

The field of the present invention pertains to digital image 
capture devices. More particularly, the present invention 
relates to a method for remotely accessing a digital camera 
via a communication network. 

BACKGROUND OF THE INVENTION 

Modem digital cameras typically include an imaging 
device which is controlled by a computer system running a 
software program. When an image is captured, the imaging 
device is exposed to light and generates raw image data 
representing the image. The raw image data are typically 
stored in an image buffer, where they are processed and 
compressed by the computer system *s processor. Many 
types of compression schemes can be used to compress the 
image data, such as the joint photographic expert group 
(JPEG) standard. After the processor processes and com- 
presses the raw image data into image files, the processor 
stores the image files in an internal memory or on an external 
memory card. 

Some digital cameras are also equipped with a liquid- 
crystal display (LCD) or another type of display screen on 
the back of the camera. Through the use of the LCD, the 
processor can cause the digital camera to operate in one of 
two modes, play and record, although some cameras only 
have a record mode. In the play mode, the LCD is used as 
a playback screen allowing the user to review previously 
captured images either individually or in arrays of four, nine, 
or sixteen images. In the record mode, the LCD is used as 
a view finder through which the user may view an object or 
scene before taking a picture. 

Besides the LCD, user interfaces for digital cameras also 
include a number of buttons or switches for setting the 
camera into one of the two modes and for navigating 
between images in play mode. For example, most digital 
cameras include two buttons, labeled and that 
enable a user to navigate or scroll through captured images. 
For example, if the user is reviewing images individually, 
then pressing one of navigation buttons causes the currently 
displayed image to be replaced by the next image. 

A digital camera has no film and, as such, there is no 
incremental cost of taking and storing pictures. Hence, it is 
possible to take an unlimited number of pictures, wherein 
the most recent picture replaces the earliest picture, for 
virtually zero incremental cost. Accordingly, this advantage 
is best realized when the camera is used as much as possible, 
taking pictures of practically anything of interest. 

One way to best utilize this unique attribute is to make the 
digital camera and its internally stored images remotely 
accessible. If the pictures are remotely accessible, the cam- 
era could be set to continuously take pictures of scenes and 
items of interest. Ideally, a user would be able to access 
those pictures at any time. The user would be able to use a 
widely available communications medium to access the 
camera from virtually an unlimited number of locations. 

The emergence of the Internet as a distributed, widely 
accessible communications medium provides a convenient 
avenue for implementing remote accessibility. Providing 
remote accessibility via the Internet leverages the fact that 
the Internet is becoming familiar to an increasing number of 



i3,848 Bl 

2 

people. Many users have become accustomed to retrieving 
information from remotely located systems via the Internet. 
There are many and varied applications which presently use 
the Internet to provide remote access or remote connectivity. 

5 Internet telephony is one such application, such as 
Microsoft's NetMeeting and Netscape's CoolTalk. 

NetMeeting and CoolTalk are both real-time desktop 
audio conferencing and data collaboration software appli- 
cations specifically designed to use the Internet as their 

10 communications medium. Both software applications allow 
a "local" user to place a "call" to a "remote" user located 
anywhere in the world. With both NetMeeting and CoolTalk, 
the software application is hosted on a personal computer 
system at the user's location and on a personal computer 

15 system at the remote user's location. Both NetMeeting and 
CoolTalk require a SLIP (Serial Line Internet Protocol) or 
PPP (Point-to-Point Protocol) account where Internet access 
is via a dial-up modem, and where the user, as is typical, 
accesses the Internet through an ISP (Internet Service 

20 Provider). Both NetMeeting and CoolTalk require personal 
computer systems for the resources necessary to run these 
applications (e.g., processing power, memory, communica- 
tions hardware, and the like). In addition, both NetMeeting 
and CoolTalk require the one user to input an IP (Internet 

25 Protocol) address for the other user in order to establish 
communication between the users. 

To facilitate the process of obtaining appropriate Internet 
addresses, CoolTalk, for example, allows on-line users to list 
their respective IP addresses with a proprietary CoolTalk 
central Web server. This allows a user to obtain a list of users 
currently on-line to whom communication can be estab- 
lished. Upon locating the desired remote user in the Internet 
address list maintained by the Web server, the local user 
places the call. 

35 

In this manner, the proprietary CoolTalk Web server 
maintains a user-viewable and user-updated "address book" 
in which users list their respective Internet addresses and in 
which they search for the Internet addresses of others with 
whom they wish to communicate. However, both NetMeet- 
ing and CoolTalk require active user input, in that each 
require the user to input his current Internet address, and in 
that each require the local user to search the address book for 
the Internet address of the remote user to be contacted. This 
can be quite problematic in the case where users obtain 
access to the Internet via dial-up connections and hence have 
different Internet addresses each time their respective dial- 
up connections are established 

In a manner similar to Intemet telephony, Internet desktop 

50 video conferencing is another prior art application which 
uses the Intemet as its communications medium. One such 
application, for example, is CU-SeeMe by White Pine. 
CU-SeeMe provides real time video conferencing between 
two or more users. As with NetMeeting and CoolTalk, 

55 CU-SeeMe is a software application which runs on both the 
local user*s personal computer system and the remote user's 
personal computer system. The personal computer systems 
provide the resources for running the application. As with 
NetMeeting and CoolTalk, CU-SeeMe requires the local 

gQ user to enter the IP address of the remote user. Uke 
CoolTalk, CU-SeeMe facilitates this process by allowing 
on-line users to list their respective IP addresses with a 
proprietary central Web server such that the addresses can be 
easily indexed and searched. 

65 Another prior art example of remote access via the 
Internet is status queries of remote devices using the Internet 
as the communications medium. A typical prior art applica- 
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lion involves interfacing a remote device with a computer limited to either chat, video conferencing, or the like. As 

system, and accessing the computer system via the Internet. such, they are not capable of establishing a connection 

For example, a vending machine can be remotely accessed between any type of user system and remote device, 

to determine its status (e.g., the number of sales made, p^ior art system is described in the copending pre- 

whether the machine needs refills^ whether the machine 5 ^-^^j ^^^^ ^^^^^ application, assigned to the assignee of 

needs mamteiiance and the like). The machme is appropn- ^^^^^ invention, entitled "A Method and System for 

ately equipped with sensors, switches, and the like, which in ^ j^^^^^^^ ^ ^ ^ 

turn are mtcrfaced to a computer system using a soitwarc a j -T „ j »i. o An/^T^ ^aa -n,- 

, . ^ -,1,1 . , Anderson and others, Ser. No. 09/044,644. This prior art 

dnver. The computer system is coupled to the Internet and , , 1 *• * *u ui *• • • 

. , . , / . , ■ , . , system presents one solution to the problem of gaining 

interfaces with the machine through the dnver, makmg the ^ ^ ^ j- •« 1 j • 1 1 a 

, , , , ,,r . remote access to those digital devices where the location and 

relevant information available over the Internet usmg Web , , ♦ jj c *l j - u- ut l li t-u- 

- „ , ^ V J- Internet address 01 the device are highly changeable. Inis 

server software. Hence, any interested user (e.g., the vending . ^ c,,^*^™ • . wr u • * *u 1 

' ^ . , , , • . pnor art system mcorporates a Web server mto the digital 

machine service company) IS able to remotely ascertain the j . en j- •* 1 n *u j j 

^ , . . . . , device, specihcally a digital camera. However, the disad- 

status of the machine via the Internet. . T *u- • Z * - ii. * *i- ^i/ u 

vantage to this prior art system is that the Web server 

Aproblem with the above descnbed pnor art applications 15 consumes valuable memory and computational resources in 

is that access to the Internet and commumcation thereon ^^^^^ ^^^^^^ ^^^-^-^^^ ^^^^ 1^^.^^^ 

requure a separate host computer system (e.g., a personal memory in a device such as a digital camera, the Web server 

computer system) on each side of the Internet connection in ^ powerful as a Web server on a server computer 

addition to the server computer system on the Internet. The system 

two host computer systems provide the computational 20 j • r - „ hi 

resources to host the respective software applications, the T?"^'/ ''^ inexpensive and powerful 

Internet access software, and any necessary device drivers. •mpletnenting remote access to digital devices 

TT,^ ^ ..t^t:r.»^^ o o;„„;fi^^«t such as digital cameras, where the location and Internet 

I ne required computational resources consume a signmcant r^j- i-.tL li^i^l j 

amount of memory. Because of this, among other reasons, address of the device are highly changeable. A further need 

the above prior art applications are not easUy transferred to 25 P.';"'^^"' presenting the 

the realm of easy-to-use, intuitive, consumer electronic <^^''"^/ fonctionality and capabilities to useK. In addition, 

devices such as digital cameras, which are small in size and > "^^^ ^"""f ^ -"^^'bod of efficiently admmistermg a 

so generaUy constrained by the amount of memory they can P^^^^'y °^ separate devices. A need also exists for an 

hoie. In addition, a consumer electronic device such as a "J obtammg the address of the device that 

digital camera that requires a separate computer system 30 transparent to the viewer. "Rie present mvention provides 

,jL • J 1 j*i- c ij a novel solution to the above needs, 
would be more expensive and complex, and therefore would 

not be consistent with the desire of consumers for lower cost SUMMARY OF THE INVENTION 
and simpler devices. 

Also, separate host computer systems (wher^ the host J^^ P^f invention provides an inexpensive and pow- 

computer systems host the software and drivers required by 35 ^^.^ "^^^^""i for implementing remote^ap^sjo^i^ital 

prior art appHcations as described above) require extra effort devices,_^^h^ig^ 

to administer, particulariy with regard to networks consist- Internet address of the device are,tehly.^£ban^ The 
ing of a large number of computer systems (e.g., digital Preseotoavention Juj:^ an_intu;tive, simple pro- 
cameras each incorporating a computer system). For tocol for presentmg the device's fiinctionality and capabih- 
example, an upgrade to the software residing on each 40 ties to users. In addition, the present mventioa provides a 
computer system has to be individually installed on each ^^'^^ of efficiently admmistermg a plurality of separate 
computer system. Also, each computer system has to be ^^^^c^^* V"^ P^^^"^ invention also provides an efficient 
individually polled to query whether the computer system P^^^s^ of obtaming the address of a device that is trans- 
has data of interest to the user, and then the data have to be P^"^^"^ 

separately accessed and collected from each computer 45 In one embodiment, the present invention is an executable 

system, then compiled. For example, in an appHcation program for accessing a digital camera via a communication 

involving digital cameras, a user may be interested in finding network u sing a Web server on a server computer system an d 

out which digital cameras have images in storage. In the a Web browser (or a program of similar function) 011 a c lient 

prior art, the user has to access each digital camera indi- c omputer system that are c ommunicatively coupled via the 

vidually. In another case, a user may have an interest in 50 In rerng t. ihe address of the digital camera is registered in an 

maintaining a record of transactions between all users and executable program on the server computer system. The 

all digital cameras. Again, in the prior art this is accom- executable program is accessed by the client computer 

plished by individually accessing each digital camera (or, system. The executable program connects the digital camera 

alternatively, each uscr^s computer system) to coUect the and the server computer system. The executable program 

data, and then compiling the complete list of transactions. 55 enables the client computer system and the digital camera to 

Another problem with the prior art is the fact that the communicate using any protocol used by these devices, thus 

applications described above require the user to know the aUowing data (e.g., images) acquiredby_ihejiigitaLcamera 

Internet address of the person or device that is being to^Ux^asfoFi^dJQihe^cli^^ 

contacted. The Internet telephony applications (e.g.. The executable program can be implemented in a variety 

CoolTalk) often employ a user-viewable and user-updated 60 of forms. For example, the executable program can be a Java 

address book to facilitate the process of locating and obtain- servlet. Alternatively, the executable program can be a 

ing the correct Internet address; however, they require active cgi-bin (Common Gateway Interface-binaries), 

user input. This is difficult in the case where users obtain For example, in the case of a digital camera, the execut- 

access to the Internet via dial-up connections, and thus have able program directly communicates commands from the 

changing Internet addresses. Still another problem with the 65 client computer system to the digital camera when both the 

prior art is that the applications described above provide client computer system and the digital camera are on-line at 

only a limited degree of functionality; that is, they are the same time. Alternatively, if the digital camera is not 
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OQ-line, the commands from the client computer system are 
first stored in the server computer system, and then later 
communicated by the executable program to the digital 
camera after a connection between the server computer 
system and the digital camera is made. The capability to 
store and then forward commands and data is not limited to 
a digital camera application nor is it limited to a particular 
data storage format. The ^data storage fonn at,can.bcanv 
form at that is^uDderstOiidJb.Y,.b.Qth>the.clieiU.computer>system 
and the^igitaLdevice. 

Images and any other data acquired by the digital camera 
are accessed by the server computer system using the 
executable program and directly transferred to the client 
computer system when both the client computer system and 
the digital camera are on-line at the same lime. Alternatively, 
if the client computer system is not on-line, the data are first 
stored by the server computer system, and then later com- 
municated to the client computer system after a connection 
between the server computer system and the client computer 
system is made. 

It should be noted, however, that the present invention can 
be readily modified to function in other embodiments, such 
as, for example, hand-held digital devices, lap top personal 
computers, and the like, which require an efiBcient process of 
obtaining the address of a device that is transparent to the 
user. 

These and other objects and advantages of the present 
invention will become obvious to those of ordinary skill in 
the art after having read the following detailed description of 
the preferred embodiments which are illustrated in the 
various drawing figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of example 
and not by way of limitation, in the figures of the accom- 
panying drawings in which like reference numerals refer to 
similar elements and in which: 

FIG. lA shows a block diagram of a remote access system 
via the Internet in accordance with one embodiment of the 
present invention. 

FIG. IB shows a block diagram of a remote access system 
via a Local Area Network in accordance with one embodi- 
ment of the present invention. 

FIG. IC shows a block diagram of a digital camera 
coupled to the Internet via an Internet Service Provider. 

FIG. 2 shows a general purpose computer system upon 
which embodiments of the present invention may be prac- 
ticed. 

FIG. 3 shows a block diagram of a digital camera for use 
in accordance with the present invention. 

FIG. 4 shows a block diagram of a computer system of a 
digital camera in accordance with one preferred embodiment 
of the present invention. 

FIG. 5 shows a memory map of a dynamic random access 
memory of a digital camera in accordance with one embodi- 
ment of the present invention. 

FIG. 6 shows a diagram of the connectivity and appHca- 
tion software of a digital camera in accordance with one 
embodiment of the present invention. 

FIG. 7 is a flowchart of a process for remotely accessing 
a digital camera implemented by an executable program in 
accordance with one embodiment of the present invention. 

FIG. 8 is a flowchart of a process employed by a digital 
camera for remote access in accordance with one embodi- 
ment of the present invention. 



3,848 Bl 

6 

FIG. 9 is a flowchart of a process employed by a client 
computer system for remote access of a digital camera in 
accordance with one embodiment of the present invention. 

5 DETAILED DESCRIPTION OF THE 

INVENTION 

In the following detailed description of the present 
invention, numerous specific details are set forth in order to 
enable one of ordinary skill in the art to make and use the 
invention, and are provided in the context of a patent 
application and its requirements. Although the present 
invention will be described in the context of a digital 
camera, various modifications to the preferred embodiment 
will be readily apparent to those skilled in the art, and the 
generic principles herein may be applied to other embodi- 
ments. That is, any digital device which displays data, 
images, icons and/or other items, could incorporate the 
features described below and that device would be within 
the spirit and scope of the present invention. Thus, the 
present invention is not intended to be limited to the embodi- 
ment shown but is to be accorded the widest scope consistent 
with the principles and features described herein. 

Some portions of the detailed descriptions which follow 
are presented in terms of procedures, logic blocks, 
processing, and other symbolic representations of operations 
on data bits within a computer memory. These descriptions 
and representations are the means used by those skilled in 
the data processing arts to most efifectively convey the 
substance of their work to others skilled in the art. A 
procedure, logic block, process, etc., is here, and generally, 
conceived to be a self-consistent sequence of steps or 
instructions leading to a desired result. The steps are those 
requiring physical manipulations of physical quantities. 

^5 Usually, though not necessarily, these quantities take the 
form of electrical or magnetic signals capable of being 
stored, transferred, combined, compared, and otherwise 
manipulated in a computer system. It has proven convenient 
at times, principally for reasons of common usage, to refer 
to these signals as bits, bytes, values, elements, symbols, 
characters, terms, numbers, or the like. 

It should be borne in mind, however, that all of these and 
similar terms are to be associated with the appropriate 
physical quantities and are merely convenient labels applied 

45 to these quantities. Unless specifically stated otherwise as 
apparent from the following discussions, it is appreciated 
that throughout the present invention, discussions utilizing 
terms such as "processing" or "computing" or "calculating" 
or "determining" or "displaying" or the like, refer to the 

50 action and processes (e.g., the processes of FIGS. 7, 8 and 
9) of a computer system or similar electronic computing 
device, that manipulates and transforms data represented as 
physical (electronic) quantities within the computer sys- 
tem's registers and memories into other data similarly 

55 represented as physical quantities within the computer sys- 
tem memories or registers or other such information storage, 
transmission or display devices. 

The present invention provides a method for making a. 
digital device (e.g., a digital camera) and its i pternally sto red 

60 d ata remotely acces sible- av-er a communicati aa-network 
s uch as the Internet or a Local Area Network (LAN) . The 
present invention is an executable program placed on a 
s erver computer system (specifically, a Web server) that 
im plements com m andsJni tiate.d.b.v^axlieat^(or user) using a 

65 c lient computer.svstem with aJWeb browseiLOr a program of 
similar functio n. Th e present invention enables the di gital 
camecaltq'Te^set to continuously. Jake pictures of scenes/ 
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items of interest and allow a client to access those pictures of a variety of means known in the art. For example, camera 

at any time. The present invention allows th ^clientao ^ acc ess 300 can be coupled to server computer system 172 via 

the di dtal ca mera^f rom_ yirt_u_all V_ an_imlimitcd_nu mbe£. of communication li ne 173b of LAN 170. This coupling can be 

l ocations an d _with the camera in virtually any location. accomplished over any network protocol that supports a 
^R^ferring now to FIG, lA, a block di^^Irnrcommu- 5 persistent network connection such as TCP (Transmission 

nication network 100 is shown. Communication network 

.J J • J -.1- u J- . Exchange), and LU6.2, and Imk layers protocols such as 

100 provides a method in accordance with one erabod.ment ^ ^ (Asynchronous Transfer 

of the present invention which implements remote access to ^^^y Alternatively, camera 300 can be coupled to server 

camera 300 and its mtemally stored data. Commumcalion computer system 172 via an input/output port (e.g., a serial 

network 100 includes camera 300. Internet Service Provider „,t^^ it-^ — — " 

, „ . ^ / V port) or server computer system 172. 

(ISP) no, Internet Service Provider 115, client (or user) Ttt- — -t-T. ,, , ,. , ^ . i ^ ^- f 

^ ' , A . * \nn icn Referrmg now to tiu. IL-, a more detailed diagram of 

computer system 120, and server computer system 190. ISP ^ - «^ i ^ * i ; : ^ r a • u 7^ 

itn J lie u *u j- *i i j , t * * Camera 300 coupled to the Internet 150 is shown. Camera 
110 and ISP 115 are both directly coupled to the Internet . i j . . , j ^ ^aa • 

y-n- . . . ' 1 J u u i-^i 300 IS oouplcd to an external modem 101. Camera 300 is 

150. Qient computer system 120 mcludes Web browser 121 ^^„„i^ ^ i ai c^,,^^o1 ^ 

c ■ A c J . K coupled to modem 101 via any or several communications 

or a program of similar function, and server computer *- io /ti r j.u 

.inA-ij -.-11 mcaos (e.g., Umversal Serial Bus, infrared unk, and the 

system 190 includes Web server 161. Web browse r 121 n x f i«i • • ^ i j . r^^r™ ' , , 

• . . Tr-m^jfT TTT * 1 Y \ J uke). Modem lUl is m turn coupled to a POl5> telephone 

mterprets HTML (HyperText Mark-up Language) docu- t ^ .l. , i . , • i i^-i 

> T — J J i_ «7 1_ jack 102 at the cameras location. Telephone tack 102 

ments and other dataLretneyed,byJvyeb.setyer 161. •* , j i^i . r j ctofi^in • 

— ^ couples modem 101 to one of modems 103 of ISP 110 via 

In the present embodiment of the present invention, an telephone company's local loop. ISP 110 is direcUy 

executable.grogra on server o o mpute'r sys tem 190, coupled to the Internet 150 via an all digital connection (e.g., 

s ^cificallv onWeb server 161. T h e_executable prog ram ^ -pj line). 

iiii glements and the connection betwe^ server Continuing with reference to FIG. IC, modem 101 is 

computer system m^c tent computer system 1207 aTd ^^^^^ ^ ^^^^^^^ ^^^^^ However, the functionality of 

c^mfiia^. ine c^ m^ py^gram can be implemepted a s ^^^^^ ^e implemented directly within the elec- 

a^Java servlet, a s a cgi-bm (Common Gateway Interfa ce- ^^^.^ ^^^^^^ ^ ^ ^^^^^ appUcation- 

binmes^ofr as n simihr t yp e pF f^ppltratinn . ^^^^^ integrated circuit or ASIC), or alternatively can be 

With reference stiU to FIG. lA, cUent computer system implemented as a software-only modem executing on a 

120 is communicatively coupled to ISP 115 via a POTS computer within camera 300. As such, it should be appre- 

(plain old telephone system) dial-up connection. Client ciated that, at the hardware connectivity level, modem 101 

computer system 120 is coupled to the Internet 150 via one ^an take several forms. For example, a wireless modem can 

of a bank of modems maintained on the premises of ISP 115. be used in which case the camera is not connected via an 

ISP 115 is coupled directly to the Internet via an all-digital external wire to any land line. Alternatively, there may be 

connection (e.g., a Tl line). However, other means of applications in which camera 300 includes suitable elec- 

coupling client computer system 120 to the Internet 150 may) tronic components enabling a connection to a conventional 

be used in accordance with the present invention. ' computer system network (e.g., Ethernet, AppleTalk, and the 

As depicted in FIG. lA, camera 300 is communicatively like), which is in turn directly connected to the Internet (e.g., 

cou pk^to server computer system IM -mJii e ^"ler net 150 via a gateway, a firewall, and the like), thereby doing away 

using a dial-up connection to ISP 110 via a POTS line. with the requirement for an ISP. Hence, it should be appre- 
DigitaL- camera 300 accesses ISP J IO using a modem, ^ ciated that the present invention is not limited to any 

coupling to one of a bank of modems maintained on the particular method of accessing the Internet 150. 
premises of ISP 110. ISP 110 is in turn coupled directly to Refer now to RG. 2 which iUustrates server computer 

the Internet 150 via an all-digital connection. However, system 190 upon which embodiments of the present inven- 

other means ofcoupling camera 300 to the Internet 150 may tion may be practiced (the following discussion is also 
be used in accordance with the present invention. 45 pertinent to a client computer system). In general, server 

With reference still to FIG. lA, it should be further computer system 190 comprises bus 200 for communicating 
appreciated that while communication network 100 shows information, processor 201 coupled with bus 200 for pro- 
camera 300 coupling to Internet 150 via one ISP (e.g., ISP cessing information and instructions, random access 
110) and user 120 coupling to Internet 150 via a separate ISP memory 202 coupled with bus 200 for storing information 
(e.g., ISP 115), user 120 and camera 300 could be coupled 59 and instructions for processor 201, read-only memory 203 
to Internet 150 through a single ISP. In such a case, user 120 coupled with bus 200 for storing static information and 
and camera 300 would be coupled to two separate access instructions for processor 201, data storage device 204 such 
ports (e.g., two separate modems out of a bank of modems) as a magnetic or optical disk and disk drive coupled with bus 
of the same ISP. 200 for storing information and instructions, optional dis- 

With reference now to FIG. IB, in another embodiment of 55 play device 205 coupled to bus 200 for displaying inforraa- 

the present invention, the communication network is com- tion to the computer user, optional alphanumeric input 

prised of Local Area Network (LAN) 170. For example, device 206 including alphanumeric and function keys 

LAN 170 may be a communication network located within coupled to bus 200 for communicating information and 

a firewall of an organization or corporation. Client (or user) command selections to processor 201, optional cursor con- 
computer system 171 and server computer system 172 are 60 trol device 207 coupled to bus 200 for communicating user 

communicatively coupled via communication fine 173a. input information and command selections to processor 201, 

Client computer system 171 includes an application that is and network interface card (NIC) 208 coupled to bus 200 for 

analogous to a Web browser for interpreting HTML docu- communicating from a communication network to processor 

ments and other data. Similarly, server computer system 172 201. 

includes an application analogous to a Web server for 65 Display device 205 of FIG. 2 utilized with server com- 

retrieving HTML documents and other data. Camera 300 puter system 190 of the present invention may be a liquid 

can be coupled to server computer system 172 through any crystal device, cathode ray tube, or other display device 
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suitable for creating graphic images and alphanumeric char- RAM disk 532 is a memory area used for storing raw and 
acters recognizable to the user. Cursor control device 207 compressed data and typically is organized in a "sectored" 
allows the computer user to dynamically signal the two- format similar to that of conventional hard disk drives. In the 
dimensional movement of a visible symbol (pointer) on a present embodiment, RAM disk 532 uses a well-known and 
display screen of display device 205. Many implementations 5 standardized file system to permit external devices, via I/O 
of the cursor control device are known in the art including 448 of FIG. 4, to readily recognize and access the data stored 
a trackball, mouse, joystick or special keys on alphanumeric on RAM disk 532. System area 534 typically stores data 
input device 206 capable of signaling movement of a given regarding system errors (for example, why a system shut- 
direction or manner of displacement. It is to be appreciated down occurred) for use by CPU 444 (FIG. 4) upon a restart 
that the cursor control 207 also may be directed and/or of computer 318 (FIG. 3). 

activated via input from the keyboard using special keys and Working memory 530 includes various stacks, data struc- 

key sequence commands. Alternatively, the cursor may be variables used by CPU 444 while executing the 

directed and/or activated via input from a number of spe- software routines used within computer 318. Working 

cially adapted cursor directmg devices. ^^^^^y -^^^^^^^ ^^^^^ -^p^^ ^^^^^ 53^ 

Referring now to FIG. 3, a block diagram of digital temporarily storing sets of raw data received from imaging 

camera 300 is shown for use in accordance with the present ^^^.^ ^pj^. 3^^ ^^^^^ ^^^^^ ^^^^ ^^^^ 

invention. Camera 300 preferably com^^^^ LCD screen 402 (FIG. 4). In the present 

314, system bus 316 and computer 318. Imagmg device 314 ^ j- * u- «• u or 

• „ , 5^i>» J 1 f- 11 ^ I ^ embodiment, each mput buffer 538 and frame buEter 536 are 
IS optically coupled to obiect 312 and electncally coupled „. /, x 
via system bus 316 to computer 318. Once a photographer ^P^^^ ^P^^^^ buffcjs (shown by the dashed bnes) to 
has focused imaging device 314 on obM^Bndr.iSing a 20 improve the display speed of the digital camera and to 
captiir e"5mt^r s omelo ther means, mstructed came ra.300 prevent the tearmg of the unage m LCD screen 402. 
to capture an image of ob j ect 312, computer 318 comm ands Referring now to FIG. 6, a diagram of the connectivity 
imagiiig-device'31'4 via^y^tem_bus,316_to. capture raw data and application software of camera 300 of FIG. 3 is shown. 
representing-GbjccH^j The captured raw data are trans- At the software level, computer 318 (FIG. 3) of camera 300 
ferfed'over-syste!S'6us3l6 to computer 318, which performs 25 hosts any network protocol that supports a persistent net- 
various processing functions on the data before storing it in work connection. This coupling can be accomplished over 
memory. System bus 316 also passes various status and any network protocol that supports a persistent network 
control signals between imaging device 314 and computer connection, such as TCP/IP (Transmission Control Protocol/ 
31^' Internet Protocol) including Point-to-Point Protocol, 

Referring now to FIG. 4, a block diagram of one embodi- 30 NetBIOS, IPX, and LU6.2, and link layers protocols such as 
ment of computer 318 is shown. System bus 316 provides Ethernet, token ring, and ATM. Protocol stack 601 interfaces 
connection paths between imaging device 314, an optional ^^h the communications hardware 602 (e.g., a modem) of 
power manager 442, central processing unit (CPU) 444, camera 300 and the appHcation layer 603. The bottom of 
dynamic random-access memory (DRAM) 446, input/ protocol stack 601 includes communication hardware inter- 
output interface (I/O) 448, non-volatUe memory 450, and 35 f^^e drivers which interface directly with the various com- 
buffers/connector 452. Removable memory 454 connects to munications hardware with which camera 300 must function 
system bus 316 via buffers/connector 452. Alternately, cam- ^ Universal Serial Bus and the like). Applications layer 
era 300 may be implemented without removable memory protocol stack 601, and operating system 604 are 
454 or buffers/connector 452. instaUed as software modules in DRAM 446 (FIG. 4) of 

Power manager 442 communicates via line 466 with camera 300. Software applications within applications layer 

power supply 456 and coordinates power management 603 interface with operating system 604. Operating system 

operations for camera 300. CPU 444 typically includes a 604 controls the hardware functionality of camera 300 (e.g., 

conventional processor device for controlling the operation taking pictures, storing pictures, and the like) via camera 

of camera 300. In the present embodiment, CPU 444 is hardware 605. Incoming data 620, such as HTTP 

capable of concurrently running multiple software routines 45 (HyperText Transfer Protocol) requests and the like, are 

to control the various processes of camera 300 within a received and outgoing data 630, such as HTML (HyperText 

multi- threaded environment. DRAM 446 is a contiguous Mark-up Language) files and the like, are transferred to and 

block of dynamic memory which may be selectively alio- from camera 300 via protocol stack 601 and communica- 

cated to various storage functions. LCD controller 490 tions hardware 602. Web browser 121 of FIG. lA (or a 

accesses DRAM 446 and transfers processed image data to 5Q program of similar function) can process data files, launch 

LCD screen 402 for display. plug-ins, and run Java applets that communicate with cam- 

I/O 448 is an interface device allowing communications era 300 in a variety of methods in addition to those methods 

to and from computer 318. I/O 448 permits an external involving an exchange of HTML files. . ^ 

device (not shown) to connect to and communicate with FIG^JMlhistrates„an-jexe cutable prog ram 700 for client 

computer 318. I/O 448 also interfaces with a plurality of 55^ comj^ter svjtemTgO (sp^ Web browser 121 of H G. 

buttons and/or dials 404, and optional status LCD 406, lA'^ r''aprogram^ similar function) to remotely ac cess 

which in addition to LCD screen 402, are the hardware ^iEgFa~300"'(FTG:-3T rwhere executable program 7(R) ~is 

elements of the camera's user interface 408. impIemc ntrd'iTrac^raance with the present invention as 

Non-volatile memory 450, which may typically comprise pj^ ^ram instructions stored in comnuter-readable mem ory 

a conventional read-only memory or flash memory, stores a 60 units ( e.g., read-only memory 203) and implemented by 

set of computer-readable program instructions to control the processor 20 1„of,sciy,eiLCQi nDuter syste xaJLjULofLEIILJlA 

operation of camera 300. (specifically, by Web server 161). Exe cutable program 7 00 

Referring now to FIG. 5, a memory map showing one p erforms fu nctions hothior andiajesponse tp Web browser 

embodiment of dynamic random access memory (DRAM) 121 (oi^a program of similar function) and camera 300. The 

446 is shown. In the present embodiment, DRAM 446 65 d escription below^rst discusses t he steps associated with 

includes RAM disk 532, system area 534, and working s etting _up a conn ection between executable prog ram 700 

memory 530. and-cameraJ iDO. then discusser the steps as fto^rinf^^ with. 
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setting up a connection between executable prograna 700 
and Web b rowser 121_ (or_a_progr am of similar functi on); 
however, the pres ent i nvent ion is not limite d by the order in 
whicHllTese'steps are presented. 

In the present embodiment, executable program 700 is 
identified and accessed by its own unique address, com- 
monly referred to as an URL.(Unified. Resource. Lx^ator), as 
is well known in the art. The.XJRL for executable program^ 
700 fully describes whercj t resides on a commuoic atiop 
n etwork (e.g., the Internet 150) and how i tis accessed J n the 
presenTem^dimenfri^ud for executable 

pTogram 700 isJhe nam^ot^a mera^SOOrAccordin gly, in one 
emDodiment_using af^^lc |:AL-exccutabie_p .ro£r. amJlOj)^ a 
staDdard_fonnat^for«.a«URL,is:^htt a://webse^^^ 
cam eraServletWellKnownName/cameraNa me. 

In st ep 705, executable program 700 receives and accep ts 
a conriection request from camera 300. Exec^ jlnbl^ prrtgram 
706 juns,constantly on Web serverJ LSJLandJs-Confi ^red to 
l isten for connection requests on a plurality of commun ica- 
tion protocol s (e.g., TCP, NetBIOS, and the like). In the 
present embodiment, camera 300 is connected to executable 
program 700 via Web server 161 as described in conjunction 
with FIG. lA, and opens the connection using the connec- 
tivity and application software described in conjunction with 

_Eia. 6. 



10 



15 



In step 740, executable program 700 receives andaccepls 
a request for a connection from a client. The client enters the 
URLiof execmable-program-7-00, includin g the name of the 
camera (e.g., camera 30 0) to which access is desired, into a 
Wcb-browsejr(e:fir rWeb browser 121 on clien tjpomputer 
systei5T20 of FIG. lA or a p rogram of similar function ). 
^Using-standar^ commumcatiqiLprotocois-such-as-^ 
-Web-server"16r'is*queried with the_URI^pj_execuU^ 
program-700— Web-server " 161"7e_c og nizes the URL and 
m'akes'the"con ng:tionl o executable.progra m 700. Thus, the 
~present'invenHon_establishes a single-location-i 
Tknown'URL where the client always goes to connect to the 
camera, no matter where the camera is or where the client is. 
(For those cases in which TCP/IP is not available — for 
example, when the device is not attached to the Internet or 
the like — camera 300 connects to executable program 700 
directly using a well-known address that is associated with 
the protocol being used, such as a NetBIOS name.)^ 



20 



In step 710, executable program 700 receives and rea ds 
registration information frona camera i6u. As mentioned 
ThfSvf^.^ ^^ypriitatilp. pj-^yrar n 7iKt is conliguTcd to comm uni- 
cate using a number of diSerent communication proioco ls. 
Such registration information includes the name 'ot the 
camera and authentication information such as security 
information and account information. E xecutable program 
7 00 uses the camera name to identify the camera and locate 
it'^in'reSpaiiik^ to a client request. 



I n step 720, executable prog ram 700 compares the reg- 
istration mfnrman'nn^wjth a ppetj^fineH access cnntrot llSt to 
determ i ne"if camera 300 is a camera for wh^ch JVe J ^ serve r 
161 IS to providejsupport and service. If not, executable 
program 7uO closes the connection between Web server 161 
and camera 300. 

-ilnstep ^725, upon successful completion of ste|2 720,' 
executable program 700 registers r-^^mpra '^Ofl ^"d^^j^ |p.^1ip. 
camera^s name and associatQ ji.j;equirprnrnt^>, "lUrh afi yni 
rity and account information. ^ Executable program 700 also 
sends a message that camera 300 is registered. At this point, 
the connection between executable program 700 can be 
either terminated or maintained at the option of the camera's 
operator. If the connection is terminated, the registration 
information is maintained by Web server 161 and can be 
later accessed by executable program 700 when a subse- 
quent connection is made with camera 300. 

In step 730, executable program 700 accepts the connec- 
tion request from camera 300 and thus has a persistent and 
long term connection with camera 300. As described above, 
the connection can be an ongoing connection maintained 
from the time when camera 300 was first registered. New 
connections can be made in the future whenever camera 300 
reinitiates the registration protocol. Once camera 300 and 
executable program 700 have established a connection, they 
then wait until' a client also makes a connection to access the 
camera. HovVever, as will be described below in conjunction 
with step 770, it is not necessary for there to be an open 
connection between the Web server and the camera at the 
same time that there is an open connection between the Web 
browser (or a program of similar function) and Web server 
to accomplish remote access of the camera in accordance 
with the present invention. 



30 
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40 



In step 745, executable program 700 then assumes control 
over the TCP/IP connection between Web browser 121 (or a 
program of similar function) and Web server 161. Execut- 
able program 700 establishes a persistent and long term 
connection between the browser and server. That is, the 
connection between Web browser 121 (or a program of 
similar function) and Web server 161 is kept open by 
executable program 700. As will be described below in 
conjunction with step 770, it is not necessary for there to be 
an open connection between the client computer system and 
the Web server at the same time that there is an open 
connection between the Web server and the camera to 
accomplish remote access of the camera in accordance with 
the present invention. 

In step 750, executable program 700 next determines if 
camera 300 is registered as discussed in conjunction with 
step 735. If camera 300 is not registered, executable pro- 
gram 700 sends an appropriate message to the client to 
indicate such. 

In step 760, if the camera is registered, executable pro- 
gram 700 validates the required access information provided 
by the client against the security and account information 
provided when camera 306 was registered. For example, 
ej cecuta^le„pjogr aj3i_7<M) validates whether the client„is 
utilizing an authorized password or user name. If not, 
executable program 700 transmits an appropriate message to 
the client. The present invention can optionally provide 
additional services related to security or account informa- 
tion. For example, it could control the type of access a client 
is permitted based on the authentication information 
received from the client, or it could verify credit information 

and bill the client for services requiring payment. 

In step 765, upon satisfactory completion of step 760, 
executable program 700 extends the connection from Web 
browser 121 (or a program of similar function) to camera 
55 300 if there is an established connection to the camera as 
described in conjunction with step 730. Hence, a client using 
Web browser 121 or a program of similar function has direct, 
remote access to camera 300 via executable program 700 in 
Web server 161. 
60 I IrTstep 770, executable program 700 forwards commands 
/from a client to camera 300, and forwards images and any 
other data from camera 300 to the client, via Web server 161 
and Web browser 121 (or a program of similar function). 
That is, executable program enables a direct communication 
65 between the client computer system and the camera allowing 
the client to remotely access and manage the camera. If the 
client and the camera are both concurrently connected to 
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executable program 700, then the client immediately Executable program 700 is located on the Web server and 

receives the data, and camera 300 immediately executes any not on camera 300, so it does not require additional and 

commands from the client. substantial memory dedicated to enabling remote access. As 

^However, if Web browser 121 (or a program of similar such, the present invention permits remote access within the 
function) and camera 300 are not each connected at the same 5 constraints of the size of the camera. In addition, in accor- 

time, remote access to the camera is still accomphshed in dance with the present invention, camera 300 does not 

accordance with the present invention. If camera 300 is not require a separate, external computer system (e.g., a per- 

on-line, a client uses Web browser 121 (or a program of sonal computer system) for connecting to ISP 110 (RG. lA) 

similar function) to access Web server 161 and executable implementing commands and transmitting data, thus 

program 700. The client transmits commands, and execut- providing an inexpensive method for providing remote 

able program 700 stores the commands on Web server 161. access to cameras. 

The client may then close the connection to the Web server. . , . i^^^^: ,u * • wr u 

„ . 1 . T/wi . 1. Also, by locating the present invention on a Web server 

Subsequently, when camera 300 opens a connection to Web . u iri cT-ir^ i w *t- i. u 

^ J . ui ^/wi . ui (e g.» Web server 161 of FIG. lA), the Web server becomes 

server 161 and executable program 700, executable program ? 1 ■ ♦ f / 1 i-. r 

. ^ ,^ jf -j.u * *u a local point tor accessing and managmg a plurahty 01 

700 retneves-tht-^commands^and forwards them to the *u 4 *u u i. - j ^ 

— J 1 J . cameras that otherwise would have ^o oe managed and 

camera.<C amera 30jLdQWDlQads 4he com mands and e xecutes c j .11- 1 * i_i -^o*-^ 

, rr^" ; — 7^ TT — " "3 rr- configured separately. For example, e xecutable program 70u ' 

them, ine results irom executing the commands are then . ,^ rrz \ — — a 

— rr "Vf^ T"^ — : — ~i — ^fn- on Web ser ver 161 could be updated with new soft ware ,_and 

sent to executable program 700, which stores them on Web r — 7-7; — ~~ -y—r TrT~z TTT" 

i_ rr^^ — ^ . . . — r: — - in effect al l cameras a ccessed throug h that ex ecutable p ro- 

serve r 161 until tb ey are retrieved by the client gram would.aaaffiaJicall.v_be updated as well. As anoth er 

— SimUarly. if camera 300 establishes a connection with 20 ej^SS^ki ^cutSTprogram ^^^^ be confi'^ to 

Web server 161 and executable program 700 but the chent c5^e data regarding interactions betwe en cUentslii^a ll 

IS not on-hne, the camera can. for example, download daineFT s accessed by the executable progam. I n lS^er 

images and any other data that executable program 700 exam ple, in accordance with the present inve ntionTTcUent 

stores on Web server 161. Camera 300 may then close the ne idi to go .onl y to a.single locati^ E"todgteSri5r^h of 
connecuon to the Web server. The client then later mak^a ,5 

connection to Web server 161 and executable program TW), hl^TdSljjhat.baye J.een..downloaded tp the ^W^^^^ 

which retrieves the data and forwards it to the client. The " '"' - ™^ 



, . . , . , , Thus, instead Qf, haying-to-acc&ss,a_Diiniber of cameras 

client can ako enter commands at this time which are stored se^iiii^iESsfeuUaYsm^^ 

by executable program 700 as described above. from which-a-dieot^ can access inforr^ atiop about several . 

In summary, with references to FIG. lA and FIG, 7, the 30 cameras^ ' '/ 

client, via Web browser 121 or a program of similar ^t. • -^u t^j u u ^ ■ ^ r a j i 

- „, , , f , f -nn. lunctioning with a Web-based interlace and widely 

function, Web server 161 and executable program 7U0, j ^ i_ / r • -i ii \ 

' ^rtrt , , . • 1 . . used Web browsers (or programs of similar function), the 

accesses camera 300 to request and retneve data. Web . . ^ . ,^ . 1 - . ^ r -i- 

, r • -1 r • . present invention provides a simple, mtuitive, and familiar 

browser 121 or a prograin of smiilar function inserts the i„i„f,^^ accessing camera 300's functionality. 

Internet address inside the data request (e.g., a HTTP ° 



. , , , , ^ 1 Accordmely, camera 300 s controls and functions are intu- 

request) and sends the request to Web server 161. Web server , * - o* u j *u • - * a 

^ ^ - J . .J - * .1. * ..t- itively easy to utilize. Since Web pages and their associated 

161 receives the data request and associates the request with * i / i. u j * . ^ u j *u vi \ 

.... 1 controls (e.g., push buttons, data entry fields, and the like) 

executable program 700, which in turn assumes the connec- ^ ^.^^ , ^ ^i. . r 

L ^ ^7 J i_ L ^-^^ i- are very ra miliar to most users, the remote access lunction- 

tion between Web server 161 and Web browser 121 (or a ^ , ' j -^i ^ 

- ,...1 ality of camera 300 can be utilized without requuing a 

program of sunilar function), and which also establishes a4o/.i. jr i- i 

. . i/ ^'^i / c extensive learning penod lor new users. For example, a 

connection between Web browser 121 (or a program or u - + i -ui * • 

... - , -^/irtT- /t_i ^ ^ consumer purchasing a remotely accessible camera is typi- 

similar runction) and camera 3U0. Executable program 70U n ; -i ^ ■ * i *l 

, , , „ 1 i- cally able to easily and immediately use the remote acces- 

subsequently lorwards commands irom the client to camera -. m * c -ii. ■ • t 

-^ftfL J ^ • . J J * / TTT-x^T £11 \ sibility functions with minimal set-up. 

300, and retrieves the requested data (e.g., a HTML tile) ■' ^ 

containing the data and sends it back to Web browser 121 (or 45 ^ illustrates a process 800 for remotely accessing 

a program of similar function). Web browser 121 (or a (F^^. 3), where process 800 is implemented as 

program of similar function) then interprets the commands program msfi^cUons stored m computer-readable memory 

and displays the resulting image. The process of accessing a ^^^^s (e.g., non-volatile memory 450 of FIG. 4) and imple- 

data file from a Web server is commonly referred to as °^ented by CPU 444 (FIG. 4) of camera 300 in accordance 
accessing a Web page. Similarly, the process of sending data 50 ^^^^ P'"^^^^ invention. FIG. 8 illustrates the process for 

files from a Web server to a Web browser is commonly remotely accessmg a camera from the perspective of the 

referred to as sending a Web page. ^^^i^^^ performed by the camera and the camera operator m 

-ru J u J u *u * • 4.- VI accordance with the present invention. 

Inus, as descnbed above, the present invention provides ^ 

an intuitive and easy-to-use interface enabling remote access step 805, camera 300 of FIG. 3 opens a connection to 
between a client and a camera. By functioning with widely 55 communication network 100 of HG. lA. In the present 

used and famiUar .Web browsers (or programs of similar embodiment, camera 300 is coupled to server computer 

function) using standard format URLs to identify the execut- system 190 (specifically, Web server 161) as described in 

able program and camera, the present invention provides a conjunction with FIG. lA, and opens the connection using 

simple and familiar interface for accessing the camera. By ^^e connectivity and appKcation software described in con- 
registering the camera and using an unchanging URL name 60 junction with FIG. 6. As described in conjunction with FIG. 

to identify the executable program and the camera, the IC, in the present embodiment, camera 300 couples direcdy 

present invention enables the cUent to locate and access the to the telephone system such that a separate and dedicated 

camera from any remote location no matter where the computer system (e.g., a personal computer system) is not 

camera is located. In addition, by using a Java servlet or a necessary. 

cgi-bin for the executable program, the present invention is 65 In step 810, with the connection made to Web server 161, 

supported by commonly used Web servers and is readily camera 300 requests a connection to executable program 

implemented. 700 (FIG. 7). For cases in which camera 300 is accessing 
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execulableprogramTOOvia, for example, a TCP/IP network then entering the commands to be stored via executable 

such as the Internet 150, then executable program 700 is program 700. Camera 300 then executes the commands 

identified with a URL that is used by the camera to access when it subsequently connects with executable program 

the executable program. For those cases in which TCP/IP is 700. 

not available (e.g., when the device is not attached to the 5 Also in step 835, camera 300 transmits data to a client. 
Internet or the like), camera 300 connects to executable Similar to the above, data from camera 300 can be trans- 
program 700 directly using a well-known address that is fitted directly to Web browser 121 or a program of similar 
associated with the protocol being used, such as a NetBIOS ^^J^ction via executable program 700 on Web server 161 
jj^^g when the client and the camera are connected to the Web 

. u ui in server at the same time. Alternatively, when a client is not 

In step 820, with the camera connected to the executable lo connected to executable program 700, the data are stored on 

program, camera 300 registers with executable program 700, y^^^ ^g^ver 161 by executable program 700, which then 

For example, camera 300 provides information including an retrieves and transmits the data to a client when the client 

identification name and authentication information such as a subsequently connects with executable program 700. 

p^gword and account infonnation. The information is elec- j^^^ process of accessing camera 300 from Web browser 

TromcaUy transmitted from camera 300 and read by execut- 15 a program of similar function occurs transparenUy 

able program 700. Based on this information, the connection ^j^^ respect to the client. In a typical case, for example, the 

between camera 300 and executable program 700 is estab- ^Uent types the URL for executable program 700 (which 

Hshed if the camera is of the type that is designated to be includes the name of camera 300) into Web browser 121 (or 

supported by Web server 161. ^ program of similar function) and hits "enter'' or "return". 

In step 830, camera 300 and executable program 700 are So accordance with the present invention, the next Web page 

linked via a persistent and long term connection; that is, the the client views is the image generated by the data returned 

connection remains open awaiting a client to request access from camera 300. Beyond entering the URL for executable 

to the camera via Web server 161. As discussed above in program 700 including camera 300, no farther action from 

conjunction with FIG. 7, it is not necessary for the camera the client is required in order to access the Web pages hosted 

and a client to be connected at the same time to executable by camera 300. 

program 700. FIG. 9 illustrates a process 900 for remotely accessing 

In step 835, camera 300 receives commands from and camera 300 (FIG, 3), where process 900 is implemented as 

transmits data to a client using a Web browser or a program program instructions stored in computer-readable memory 

of similar function on a client computer system (e.g., client units (e.g., read-only memory) and implemented by the 

computer system 120 and Web browser 121 of FIG. 1 A or central processor of client computer system 120 

a program of similar function). As described above in (specifically, Web browser 121 or a program of similar 

conjunction with FIG. 7, the commands and data can be function) of FIG. lA. FIG. 9 illustrates the process for 

transmitted through an active connection or stored on the remotely accessing a camera from the perspective of the 

Web server. actions performed by the client in accordance with the 

In the present embodiment, camera 300 is provided with present invention, 
several different operating modes for supporting various In step 905, the client opens a network connection such as 
camera functions. In capture mode, camera 300 supports the a dial-up connection to ISP 115 of FIG. lA. 
actions of preparing to capture an image and of capturing an In step 910, the client enters into a Web browser (e.g., 
image. In review mode, camera 300 supports the actions of Web browser 121 on client computer system 120 of FIG. lA 
reviewing camera contents, editing and sorting images, and or a program of similar function) the URL of executable 
printing and transferring images. In play mode, camera 300 program 700, including the name of the camera (e.g., camera 
allows the client to view screen-sized images in the orien- 300) to which access is desired. Alternatively, the client 
lation that the image was captured. Play mode also allows enters the URL of executable program 700 only. (For those 
the client to hear recorded sound associated to a displayed cases in which TCP/IP is not available — for example, when 
image, and to play back sequential groupings of images, the device is not attached to the Internet or the like — camera 
which may comprise time lapse, slide show, and burst image 300 connects to executable program 700 directly using a 
images. The client preferably switches between the capture, well-known address that is associated with the protocol 
review, and play modes. being used, such as a NetBIOS name.) Using standard 
Camera 300 is capable of implementing a wide variety of 50 communication protocols such as TCP/IP, Web server 161 is 
remote access and remote imaging/surveillance applica- queried with the URL for executable program 700. Web 
tions. In the present embodiment, camera 300 only records server 161 recognizes the URL and makes the connection to 
successive images for remote access by the client. The executable program 700. A persistent and long term two- 
images are loaded into the camera's memory on a first-in, way connection is opened between the chent on Web 
first-out (FIFO) basis, with the earliest recorded image being 55 browser 121 (or a program of similar function) and execut- 
replaced by the latest recorded image. The number of images able program 700. 

available to the client depends upon the amount of installed In step 915, the client enters the authentication informa- 

memory in the camera. tion required to gain access to executable program 700 and 

With reference still to step 835 of FIG. 8, when the client camera 300. 
and the camera are connected to the Web server at the same 60 In step 920, as explained above, from his/her remote 

time, the commands can be transmitted directly from Web location the chent sends commands to camera 300 and 

browser 121 (or a program of similar function) to camera receives images fi-om the camera. As explained above, the 

300 via executable program 700 on Web server 161, and client and the camera do not have to be connected to the Web 

camera 300 then executes the commands on-line. server at the same time to enable remote access. Depending 
Alternatively, when camera 300 is not connected to execut- 65 on the particular application, the Web page for camera 300 

able program 700, a cUent can store commands on Web can include control buttons, data entry fields, drop-down 

server 161 by accessing the Web server in a normal fashion, menus, and the like. 
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Thus, executable program 700 enables the client to access 
from a remote location the functional controls of camera 300 
as well as the images and other data acquired by the camera. 

Pseudo-Code Sections A, B, C, D and E below provide 
additional details regarding processes 700, 800 and 900 of 5 
FIGS. 7, 8 and 9. Pseudo-Codes Sections A through E 
represent the method of one embodiment of the present 
invention. However, it is appreciated that other embodi- 
ments are possible in accordance with the present invention. 
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With references to FIGS. 7 and 9, the pseudo-code for the 
connection of a client to the server computer system, spe- 
cifically to executable program 700, is described in accor- 
dance with one embodiment of the present invention in 
Pseudo-Code Section A below. 



Pseudo-Code Section A; Client Connection Setup 



1. Client sends HllV Post command to http://serverName/gateway device="dcviceName" 
Note: authentication/seairity data is optional and is handled by the browser. 

2. Client receives HTTP response from Gateway 

3. If response is OK or OKDataPresent 
{ 

Client has TCP connection it can use to send/receive anything to/ from the device. 
The protocol used can be any that the Client & Device agree upon. 

} 

else 
{ 

The response is Failed or Data Present. 
The TCP connection is closed: 

} 



Note: the OKDataPresent and DataPresent responses are informational. The Client at any time 
on separate connections may issue a CacheData or GetCache command to the Gateway. See 
algorithms C. 



30 With references to FIGS. 7 and 8, the pseudo-code for the 
connection of a device (e.g., digital camera 300 of FIG. lA) 
to the server computer system, specifically to executable 
program 700, is described in accordance with one embodi- 
ment of the present invention in Pseudo-Code Section B 

35 below. 

Pseudo-Code Section B: Device Connection Setup/ 
Registration 



1. Device establishes a connection to the Gateway using any networking protocol 
supported by the Gateway(TCP, NetBIOS, IPX, 802.2, etc) using a known address. 

2. Device sends a Register request to the Gateway on the connection passing 
its name (and optionally authentication/security information). 

3. [Device receives response from Gateway 

4. [f the response is OK or OKDataPresent 
{ 

The Device may use the existing connection to wait for requests from clients, 
or the Device may optionally close the connection. 

} 

else 

{ 

The response is Failed or DataPresent 
The connection is closed. 

} 



Note: the OKDataPresent and DataPresent responses are informational. The Device at any 
time on separate connections may issue a CacheData or GctCachc command to the 
Gateway. See algorithm D. 
60 

With reference to FIG. 7, the pseudo-code for executable 
program 700 in response to a client connection request is 
described in accordance with one embodiment of the present 
invention in Pseudo-Code Section C below. 

Pseudo-Code Section C: Gateway Handles Qient Con- 
nection Request 
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Start: 

Wait for incomiflg requests from clients 

if its at an HTTP Post command with parameters CacheData and deviceName 
{ 

go to CacheData 

} 

else if its an HTTP Get command with parameters GctCachc and dcviccNamc 
{ 

go to GetCache 

} 

if its an HTTP Post command from a client with the name of device 
{ 

go to Connect 

} 

else 
{ 

go to Fail 

} 

Connect: 

Look up device by name in registry 

if the device entry is found 

{ 

if there is a device conaection id in the entry 

if the entry is not busy 

go to Success 
else go to Fail 

else 

Attempt to establish connection with device at last known address 
if connection established 

go to Success 

else to to Fail 

} 

} 

else 
{ 

send Fail response 
close connection 
go to Start 

} 

Fail: 

if there is data in the cache 
{ 

set response to DataPresent 

} 

else 
{ 

set response to Fail 

] 

send response 
close connection 
go to Start 
Success: 

if there is data m the cache 
{ 

set response to OkDataPresent 

} 

else 
{ 

set response to Ok 

} 

store connection id of the client in the registry entry 
go to Start 
CacheData: 

Look up device name in registry 

if not found 

{ 

set response to Fail 
send response 
close connection 
go to Start 

} 

else 
{ 

store data in Cathe for device with identification information 
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send Ok response 
dose connection 
go to Start: 

} 

GetCache: 

Look up device name in registry 

if not found 

{ 

set response to Fail 
send response 
close connection 
go to Start 

} 

else 
{ 

send data in Cache for this client 
close connection 
go to Start 



20 



With reference to FIG, 7, the pseudo-code for executable 
program 700 in response to a device connection request is 
described in accordance with one embodiment of the present 
invention in Pseudo-Code Section D below. 

Pseudo-Code Section D: Gateway Handles Device 
Requests 



30 



Start: 

Wait for incoming requests from devices 
Receive incoming request 
if its a Register request 
{ 

go to Register 

} 

else if its a CacheData request 
{ 

go to CacheData 

} 

else if its a GetCache request 
{ 

go to GetCache 

} 

else 
{ 

return Failed 
close connection 
go to Start 

.} 

Register: 

Note: The gateway may optionally authenticate device 

Get device name from Register request 

look up name in table 

if name is found 

{ 

go to Success 

} 

else 
{ 

The gateway may optionally add the name or reject the 
registration aUempt, then go to Success or Fail 
respectively. 

} 

Success: 

check for the presence of cached client data 

if cached data is present 

{ 

set response to OkData Present 

{ 

else 

{ 

set response to Ok 

} 



40 



-continued 



Store a connection id for the incoming connection in 
the registry entry for the device, 
send response 
go to Start 



FaU: 



if cached data from clients is present for this device 



{ 
} 

else 
{ 



set response to DataPresent 



set response to Fail 
] 

send response 
close connection 
go to Start 
CacheData: 

lx)ok up device name in registry 
if not found 



{ 



} 

else 
{ 



set response to Fail 
send response 
close connection 
go to Start 



) 



store data in Cache for client 
send Ok response 
close connection 
go to Start: 



GetCache: 

Look up device name in registry 

if not found 

{ 

set response to Fail 
send response 
close coimection 
55 go to Start 

) 

else 



{ 



send data in Cache for device to the device 
close coimection 
go to Start 



With reference to FIG. 7, the pseudo-code for executab le 
[)rograrn 700^sg ecificallv theiiandling of da^„whe amOpe D 
co nnection is present between the device and the, cli ent 
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embodiment of the present inveDti Qajui,£ssiLdo-Code Sec- 
tion~E^^low. 

Pseudo-Code Section E: Gateway Handles Data on 
Existing Connections 



Wait for daU 

Map the incoming connection id to its partner connection id 

if there is incoming data 

{ 

Send the data out on the partner connection id 
go to Start 

} 

else if the connection dosed 
if its a client connection 

{ 

Remove the client's connection id from the 
device's entry in the registry. 

} 

else 

{ 

Remove both the client and device connection ids 
from the device's entry in the registry. 
Qose the client's connection, 
go to Start 



10 



) 



} 
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go to Start 



As described above, the remote accessibility of camera 
300 provides for many new applications of digital imagery- 
One such application involves setting up camera 300 at 
some remote location and using it to take pictures at suc- 
cessive intervals. These pictures would be accessed via the 
Internet 150 as they are taken. The interval can be adjusted 
(e.g., more or less pictures per minute) in response to 
c ommands en tered by a client via a Web browser (e.g., Web 
b rowser 121 ot HU. lAor a prfl fi uuu u £ jimilai fe metion). 

Another application involves using camera 300 in con- 
junction with a motion detector. When used in conjunction 
with a motion detector, camera 300 can be configured to 
capture an image in response to receiving a signal from the 
motion detector (e.g., detecting the motion of an intruder), 
thereby taking a picture of whatever triggered the detector*s 
signal output. Alternatively, camera 300 can detect motion 
by simply comparing successive images to detect changes 
between them, thereby dispensing with the need for a 
separate motion detector. 

Yet another application involves using camera 300 in 
conjunction with a remote aiming device. Camera 300 can 
be mounted on a remotely operated aiming device (e.g., a 
motorized tripod). The aiming devicc-is-coatr Qllcd via th e 
Internet 150 in the sa me manner the camera is controlled via 
the Internct'tSOrAn ernaUvely^.caiagja.^i^^ couple d 
tn_r9 Ptml the j fim ote aiming device directly. The rem ote 
ajmingjevicejall ows a client to control the field of view of 
t he camera 300 in the same_manner the cUe ntcontrols other 
f unctionalit y_(e.g^ picture resolu tion, picture mtcrva i^and 
the like ). 

In this manner, executabk program 700 of the present 
inv ention is able to impTement sophisticated remote surve il- 
la nce of the type previously performed^ b y expensiv e, prior 
art closed circuit television devices. Unlike the prior art, 
however, executable program 700 is inexpensive and rela- 
tively simple to implement. 

Thus, the present invention provides a method for making 
a digital camera and its internally stored data remotely 
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accessible. The present invention enables the digital camera 
to besefto continuously take pictures of scenes and items of 
interest and to allow a user to access those pictures at any 
time. The present invention implements remote accessibility 
via a communication network such as the Internet, thus 
allowing the user to access the digital camera from virtually 
an unlimited number of locations and with the camera in 
virtually any location. 

A digital camera in accordance with the present invention 
does not require a separate, external computer system (e.g., 
a personal computer system) for Internet connectivity, thus 
providing an inexpensive method for making remotely 
accessible digital cameras widely available. In addition, a 
digital camera in accordance with the present invention is 
accessed via the widely used and very familiar Web browser 
(or a program of similar function). By functioning with 
typical, widely used Web browsers (or programs of similar 
ftinction), the present invention provides a simple, intuitive, 
and familiar interface for remotely accessing the digital 
camera's functionality and capabilities. In so doing, th e 
co ntrols and functions of the digital came ra are intuitively 
easy to utilize, and do not require an extensive learnmg 
period for new users. The prese nt invention also provides an 
eflS cient and user- transparent process of obtainin g the 
acldress of a digital camera. Also, the_ present_ invention 
provides a method for efiSciently administering a plurality of 
separate digital cameras. 

Although the present invention is described in the context 
of a digital camera, it is not limited to this embodiment. 
Hence, the present invention does not provide only a limited 
degree of functionality as in the prior art applications; that 
is, it is not limited to either chat or video conferencing, or the 
like. As such, the present invention is capable of establishing 
a connection between any type^fclient system and remote 
device . ~ 

The foregoing descriptions of specific embodiments of the 
present invention have been presented for purposes of 
illustration and description. They are not intended to be 
exhaustive or to limit the invention to the precise forms 
disclosed, and obviously many modifications and variations 
are possible in light of the above teaching. The embodiments 
were chosen and described in order to best explain the 
principles of the invention and its practical application, to 
thereby enable others skilled in the art to best utQize the 
invention and various embodiments with various modifica- 
tions as are suited to the particular use contemplated. It is 
intended that the scope of the invention be defined by the 
Claims appended hereto and their equivalents. 

What is claimed is: 

1, A method for allowing a client computer to remotely 
access a digital image capture unit via a communication 
network wherein a server computer system and said client 
computer system are communicatively coupled with com- 
munication equipment, said method comprising the steps of: 

a) allowing said digital image capture unit to establish 
communication with said server computer system over 
said network, wherein said digital image capture unit 
includes connectivity software that enables said digital 
image capture unit to establish a network connection 
with said server computer system; 

b) receiving an address of said digital image capture unit 
and registering said address in an executable program 
on said server computer system, wherein said digital 
image capture unit automatically registers said address 
with said server computer system; 

c) allowing said client computer system to access said 
executable program on said server computer system; 
and 
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d) establishing direct communication between said client 
computer system and said digital image capture unit by 
communicating commands between said client com- 
puter system and said digital image capture unit via 
said executable program, such that data captured by 
said digital image capture unit is transferred to said 
client computer system via said server computer sys- 
tem. 

2. The method of claim 1 wherein said communication 
network is the Internet. 

3. The method of claim 1 wherein said communication 
network is a Local Area Network. 

4. The method of claim 1 wherein said image capture unit 
is a digital camera, 

5. The method of claim 1 wherein step a) further com- 
prises communicating authentication information between 
said digital image capture unit and said executable program. 

6. The method of claim 1 wherein said executable pro- 
gram is a Java servlet. 

7. The method of claim 1 wherein said executable pro- 
gram is a cgi-bin (Common Gateway Interface-binaries). 

8. The method of claim 1 wherein step c) further com- 
prises connecting said digital image capture unit to said 
server computer system via a Local Area Network. 

9. The method of claim 1 wherein step c) further com- 
prises connecting said digital image capture unit to said 
server computer system via an input/output port of said 
server computer system. 

10. The method of claim 1 wherein step c) further 
comprises connecting said digital image capture unit to said 
server computer system via the Internet. 

11. The method of claim 1 wherein step d) further 
comprises storing said commands in a memory unit of said 
server computer system and communicating said commands 
to said digital image capture unit at a time when a connec- 
tion is made between said server computer system and said 
digital image capture unit. 

12. The method of claim 1 further comprising the steps of: 

e) accessing via said executable program data acquired by 
said digital image capture unit; and 

Q transferring said data from said digital image capture 
unit to said client computer system via said server 
computer system. 

13. The method of claim 12 further comprising storing 
said data in a memory unit of said server computer system 
and communicating said data to said client computer system 
at a time when a connection is made between said server 
computer system and said client computer system. 

14. A computer system comprising: 
a processor coupled to a bus; and 

a memory unit coupled to said bus and having stored 
therein an executable program that when executed by 
said processor implements a method for allowing a 
client computer to remotely access a digital image 
capture unit via a communication network, said method 
comprising the steps of: 

a) allowing said digital image capture unit to establish 
communication with said server computer system 
over said network, wherein said digital image cap- 
ture unit includes connectivity software that enables 
said digital image capture unit to establish a network 
connection with said server computer system; 

b) receiving an address of said digital image capture 
unit and registering said address with said executable 
program, wherein said digital image capture unit 
automatically registers said address with said server 
computer system; 
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c) allowing said client computer system to access said 
executable program over said communication net- 
work; and 

d) establishing direct communication between said 
client computer system and said digital image cap- 
ture unit by communicating commands between said 
client computer system and said digital capture unit 
via said executable program. 

15. The computer system of claim 14 wherein said 
computer system is a server computer system. 

16. The computer system of claim 14 wherein said digital 
image capture unit is a digital camera. 

17. The computer system of claim 14 wherein said 
executable program is a Java servlet. 

18. The computer system of claim 14 wherein said 
executable program is a cgi-bin (Common Gateway 
Interface -binaries). 

19. The computer system of claim 14 wherein said digital 
image capture unit and said computer system are connected 
via a Local Area Network. 

20. The computer system of claim 14 wherein said digital 
image capture unit and said computer system are connected 
via an input/output port of said computer system. 

21. The computer system of claim 14 wherein said digital 
image capture unit and said computer system are connected 
via the Internet. 

22. In a communication network comprising a server 
computer system and a client computer system communi- 
catively coupled with communication equipment, a method 
for allowing said client computer to remotely access a digital 
camera via said communication network, said method com- 
prising the steps of: 

a) allowing said digital camera to establish communica- 
tion with said server computer system over said com- 
munication network, wherein said digital camera 
includes connectivity software that enables said digital 
camera to establish a network connection with said 
server computer system; 

b) receiving an address of said digital camera and regis- 
tering said address in an executable program on said 
server computer system, wherein said digital camera 
automatically registers said address with said server 
computer system; 

c) allowing said client computer system to access said 
executable program on said server computer system; 

d) establishing direct communication between said client 
computer system and said digital camera by commu- 
nicating commands between said client computer sys- 
tem and said digital camera via said executable pro- 
gram; 

e) accessing via said server computer system data 
acquired by said digital camera; and 

f) transferring said data from said digital camera to said 
client computer system via said server computer sys- 
tem. 

23. The method of claim 22 wherein said executable 
program is a Java servlet. 

24. The method of claim 22 wherein said executable 
program is a cgi-bin (Common Gateway Interface-binaries). 

25. A method for allowing a client computer to remotely 
access a digital image capture device via a communication 
network wherein a server computer system and said client 
computer system are communicatively coupled with com- 
munication equipment, said method comprising the steps of: 

a) allowing said digital image capture device to establish 
communication with said server computer system over 
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said communication network, wherein said digital 
image capture device includes connectivity software 
that enables said digital image capture device to estab- 
lish a network connection with said server computer 
system; 5 

b) receiving an address of said digital image capture 
device and registering said address in an executable 
program on said server computer system, wherein said 
digital image capture device automatically registers 
said address with said server computer system; 10 

c) allowing said client computer system to access said 
executable program on said server computer system; 
and 
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d) establishing direct communication between said client 
computer system and said digital image capture device 
by communicating commands between said client com- 
puter system and said digital image capture device via 
said executable program, such that data from said 
digital image capture device is transferred to said client 
computer system via said server computer system. 

26. The method of claim 25 wherein said executable 
program is a Java servlet. 

27. The method of claim 25 wherein said executable 
program is a cgi-bin (Common Gateway Interface-binaries), 

***** 
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